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ABSTRACT OF THE DISCLOSURE 

Color deviations of images are analyzed using a sensor. The received image 
sensor signal is analyzed pixel by pixel. An image sensor signal is produced for each 
color channel from a plurality of color channels. An image sensor signal from a first 
channel, and one from a second channel, are combined. An output signal of a first color 
contrast channel is generated. Now an image sensor signal from a third channel is 
combined with the ones from the first and second image sensors. An output signal of a 
second color contrast channel is generated. The outputs of these color contrast 
channels are classified. 
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METHOD FOR ANALYZING THE COLOR DEVIATIONS IN IMAGES USING AN 

IMAGE SENSOR 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[001] This U.S. patent application is the U.S. national phase, under 35 

USC 371 of PCT/DE2003/002146. filed June 27. 2003. published as WO 

2004/017034 A1 on February 26. 2004 and claiming priority to DE 102 34 085.4 

filed July 26. 2002. the disclosures of which are expressly incorporated herein bv 

reference. 

FIELD OF THE INVENTION 
[002] The present invention is directedf relates] to methods for using an 

image sensor for analyzing color deviations in images [in accordance with the 
preambles of claims 1 or 2]. The image signal received from the image sensor is 
analyzed pixel by pixel. 



[WO 2004/017034] [PCT/DE2003/02146] 

BACKGROUND OF THE INVENTION 

[003] The trichromatic model that is fmostly] used most frequently in 

technology for describing additive color images is the RGB model. By 

utilization fmeans] of the RGB model, an[the] image space is described by the 

three basic or primary colors^ red, green and blue. It is a particularly] 

disadvantaae. fdisadvantageous] in connection with this model A that the color 

description performed by [means of] the RGB model does not correspond to the 

color perception of the human eye, since the reaction of the human perception, i.e. 

the detection through the sensory organs, is not taken into consideration in the 

RGB model . 

[004] DE 44 19 395 A1 discloses a method for analyzing color images by 

the use fmeans) of an image sensor, whose image signals are analyzed pixel by 
pixel. In the process., the image signals are separated in accordance with 
colorfulness and with brightness. 

[005] DE 692 24 812 T2 describes a method for image processing^, 

wherein] RGB signals are non-linearly transformed into color signal values L, C1, 
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C2. 

[006] A method for classifying color images by the usef means] of fuzzy 

logic is known from DE 198 38 806 A1. 

[007] USSN 2002/021.444 A1 describes calculation specifications for 

image processing with the use of weighting factors for the individual color 
components. 

[008] A method for analyzing color deviations in images is set forth in the 

article bv Michael J. Swain and Dana H. Ballard. "Color Indexing." Internat'l. 
Journal of Computer Vision. 7:1 11-32 (1991). XP000248428. Compensation 
color channels are generated from color channels, which compensation color 
channels correspond to the receptive fields of the human eve. These 
compensation color channels are used for preparing histograms. 
[009] EP 0 473 432 B1 discloses an image analysis method which 

provides a transformation with several input signals with associated calculation 
specifications. 
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SUMMARY OF THE INVENTION 

[010] The object of the present invention is directed to providina fbased on 

creating] methods using an image sensor for analyzing color deviations of images. 

[011] In accordance with the present invention, this object is attained by 

providing an image sensor that is used to analyze color deviations of images. An 

image signal received from the image sensor is analyzed pixel bv pixel. An image 

sensor signal is generated for each of the several color channels. Image sensor 

signals from two of the channels are linked bv a calculation specification and an 

output signal of a first compensation channel is generated. Linkage of the image 

sensor channel of the third color channel with the image sensor signals of the first 

and second color channels is accomplished bv using a second calculation 

specification to generate an output signal of a second compensation color 

channel. These color channels are classified fmeans of the characteristics of claim 

1 or 2]. 

[012] Three cone types, which each absorb light in different spectral 

ranges, exist in the human eye. The maximum absorption of the S-cone type lies 
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in the blue range, namely at 420 nm . The f. the] M-cone type absorbs maximally in 

the green range, namely at 534 nm . The f, and the] L-cone type has its absorption 
maximum at 564 nm in the yellow/red spectral range. Seeing by use[means] of 
three types of cones is called trichromatic vision. AnfThe] individual color 
perception is triggered by the different excitation strengths of the individual cone 
types. Identical excitation of all three types of cones leads to the perception of the 
color white. However, by usefmeans] of the trichromatic vision modeL it is not 
possible to explain color perception phenomena, such as color antagonism and 
color constancy, for example. 

[013] Color antagonism means that defined colors can never be seen in 

transitions, so that no color transition between these colors is possible. Colors 
which show color antagonism are called compensation or complementary colors. 
The color pairs red/green and blue/yellow, as well as black/white should be 
mentioned here. 

[014] With color constancy, the different spectral distribution of the light, 

which for example is a function of the weather or daylight conditions, is 
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compensated. 

[015] Hering developed hisfthe] compensation color theory in 1920 [in 

order] to explain these color perception phenomena in a way that was different 
from the classic trichromatic color model. The compensation color model 
assumes that the cones are arranged in receptive fields, namely in blue/yellow 
fields and |n red/green fields. Receptive fields are [here] understood here to be 
neurons, and describe the manner in which the light signals coming from the 
cones are further processed by the neurons. Substantially two types of receptive 
fields are responsible for color vision. The first receptive field obtains its input from 
the L- and M-cones . The [, the] second receptive field obtains its input from the S- 
cones, together with differently weighted signals from the L- and M-cones. It is 
assumed that subtractive color mixing of the excitations of the cones is performed 
in the plane of the neurons or in these receptive fields. 
[016] In the process for analyzing color deviations of printed images, 

an[the] image signal , that is received from the image sensor A is analyzed pixel by 
pixel in a manner which is generally known [per se]. In accordance with the 
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present invention, the image signal is recorded by the image sensor in three color 

channels, which are separated from each other, and which are used for 
reproducing the three cone types in the human eye with their different spectral 
sensitivities. Each one of the three color channels has a characteristic spectral 
sensitivity. The two receptive fields A representing the second stage of color 
processing in human vision^ are simulated by an appropriate linkage of the image 
sensor signals of the three color channels, which are separated from each other. 
In the technical model, the red/green field of human color perception represents 
the first compensation color channel. The output signal of the first compensation 
color channel is generated by the linkage of the image sensor signal of a first color 
signal with the image sensor signal of a second color signal. Linkage is performed 
by the utilization fmeans] of a calculation specification consisting of at least one 
arithmetic rule. In the technical model, the blue/yellow field is generated by linking 
the image sensor signal of a third color channel with a combination of the image 
sensor signals of the first and second color channels. In the technical model, the 
blue/yellow field corresponds to the second compensation color channel. The 



-7- 



[WO 2004/017034] [PCT/DE2003/02146] 

output signal of the second compensation color channel is generated by 

usefmeans] of the above described linkage. Linkage is performed by [means of] a 
second calculation specification consisting of at least one arithmetic rule. A 
classification of the output signals from the two compensation color channels takes 
place in the next step for evaluating the examined pixel. It is decided by [means 
of] this classification whether the image content of the examined pixel corresponds 
to a defined class, by the use fmeans] of which classification an 
acceptable/unacceptable determination fclassification] can be made. 
[017] It is without great importance, for the principle of the present 

invention, in which spectral range the three color channels of the method are 
located, so[as] long as these three color channels are color channels which are 
separated from each other. A preferred embodiment of the present invention js 
one[consists] in which fthat] the three color channels correspond to the basic colors 
of the RGB model, namely red, green and blue. This has the advantage that it is 
possible to use a widely distributed color model. 

[018] To match the spectral sensitivity of each color channel to the spectral 
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perception of the corresponding cone of the retina of the human eye, it is 

beneficial fuseful] if the spectral sensitivity of every color channel can be matched 
to spectral sensitivities of the cones. 

[019] It is of secondary importance., for the principle of the present 

invention in which way the two output signals of the compensation color channels 
are generated. One possibility consists in that one arithmetic rule of the first 
calculation specification provides the formation of a weighted differentiation 
between the image sensor signals of the first color channel, and/or an arithmetic 
rule of the second calculation specification provides the formation of a weighted 
differentiation between the weighted sum of the image sensor signals from the first 
and second image sensor channels and the third color channel. 
[020] In accordance with a further preferred [exemplary] embodiment of 

the present invention, at least one signal in at least one compensation color 
channel is subjected to a transformation specification, and in particular is 
subjected to a non-linear transformation specification, after and/or prior to the 
linkage. A transformation has the particular advantage that the digital character of 
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electronically generated recordings can be taken into consideration. By the 

use[means] of the transformation specifications, it is also possible to transform a 
signal from the color space into a space in which the excitation of the cones can 
be described. In many preferred fexemplary] embodiments, the signals in both of 
the compensation color channels are subjected to a transformation. 
[021] With fSince with] human vision, the receptive fields are characterized 

by a low pass behaviorJt[, it] is thus useful if at least one signal in at least one 
compensation color channel is filtered by the use fmeans] of a low pass filter. In 
accordance with a particularly preferred [exemplary] embodiment of the present 
invention , the output signal of each compensation color channel is filtered by the 
usefmeans] of a low pass filter. 

[022] In accordance with a particularly preferred [exemplary] embodiment 

of the present invention , the method for analyzing color deviations in images. 
using an i mage sensor, has a learning mode of operation and an inspection mode 
of operation . In the course of the learning mode of operation , at least one 
reference image is analyzed pixel by pixel . The [. and the] two output signals from 
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the two compensation color channels fgrmed[created] by the reference image are 

stored in a reference memory. This means that the image content of the reference 
image is actually recorded in three color channels, that the image signals of each 
color channel are matched in accordance with perception, and that these image 
signals are subsequently linked with each other A in accordance with the 
compensation color model. Then A the output signals from each compensation 
color channel are stored,, pixel by pixeL in the reference data memory. In a[the] 
subsequent inspection mode, the output signals from the appropriate pixe l that 
are generated by a test image,, are compared with the corresponding value in the 
reference data memory, and a classification decision is made regarding the 
acceptability of the test image . 

[023] In order to take permissible fluctuations of the image content, as well 

as to take fa] fluctuations of the conditions existing during the image recording, into 
consideration, it is useful if the values stored in the reference data memory are 
formed by analyzing several reference data sets, so that A for each value in the 
reference data memory^ a permissible tolerance window is provided [fixed], and 
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within which tolerance window an output signal value of a compensation color 

channel generated during the image inspection^ can fluctuate. In this case A the 
reference variable of the output signal of a compensation color channel can be 
determined, for example, by [means of] forming the average arithmetic value of the 
individual values resulting from the reference data sets. The tolerance window 
can be determined, for example, from the minimum and maximum values of the 
output signal , or from the standard deviation of the output signals of the 
compensation color channels generated from the examined reference images. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[024] Preferred fExemplarv] embodiments of the present invention are 

represented in the drawings and will be described in greater detail in what follows. 
[025] Shown are in: 

Fig. 1, a schematic representation of a[the] method for analyzing 
color deviations in print images with a compensation color model in accordance 
with the present invention , and in 
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Fig. 2, a flow chart of the learning and inspection mode. 



DESCRIPTION OF THE PREFERRED EMBODIMENT 
[026] As may[can] be seen in Fig. 1 , [the] recording of [the] image signals 

of an image is accomplished by an image sensor and takes place in three color 
channels 01, 02, 03, which are separated from each other. In the present 
preferred fexemplary] embodiment, the three separated color channels 01, 02, 03 
are the color channels red 01 , green 02 and blue 03. Each one of the three color 
channels has an adjustable spectral sensitivity. This has , as an [the] advantage., 
that the characteristic of each color channel 01 , 02, 03 recorded bv the image 
sensor can be matched to the conditions of the existing set of problems. Thus,, it 
is possible, for example, to match the spectral sensitivity of a color channel 01 , 02, 
03 to the spectral sensitivity of the appropriate cone of the retina of the human 
eye. 

[027] In the method for analyzing the color deviations in images in 

accordance with the present invention, the spectral content of an image is 
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analyzed pixel by pixel. For modeling the two receptive fields^ red/green and 

blue/yellow of the human eye, the image sensor signals of the color channels 01, 
02, 03 are linked with each other in accordance with fby means of] the method of 
the present invention. Prior to such an fthe] actual linkage of the image sensor 
signals, by theuse[means] of [the] calculation specifications 04, 06[05], each 
image sensor signal in two resultant fthe] compensation color channel 07, 08 is 
subjected to a non-linear transformation 09. The digital character of the 
electronically generated recordings is taken into consideration by this. 
Subsequently, each signal is weighted with a coefficient K, (I = 1 ... 4). By the 
use[means] of this process, it is achieved that a pure intensity change of the initial 
image does not provide a contribution to one of the output signals 12, 13 of the 
first and second compensation color channels 07, 08. The generation of the 
output signals 12, 13 of the first and second compensation color channels 07, 08 
takes place in a manner analogously to the generation of the signals of the 
receptive fields in the human retina. This means that a linkage is performed by the 
utilization fmeans] of the calculation specifications 04, 06 of the color channels 01, 
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02, 03 in a manner corresponding to the linkage of the cones of the human retina. 
To formf For creating] the output signal 12 of the red/green compensation color 
channel 07, the image sensor signals of the red color channel 01 and the image 
sensor signals of the green color channel 02 are linked with each other by 
usef means] of the first calculation specification 04. To form For generating] the 
output signal 13 of the blue/yellow compensation color channel 08, in the present 
preferred fexemplary] embodiment the image sensor signal of the blue color 
channel 03 is linked with the minimum one signal 14 of the image sensor signals 
of the red color channel 01 and of the green color channel 02 by usefmeans] of the 
calculation specification 06. The receptive fields of the human retina are 
characterized by a low pass behavior. Accordingly, in the present 
preferred fexemplary] embodiment, the signals obtained by each linkage are 
subjected to a low pass filtering process 16 usino fwithl a Gauss low pass filter. 
[028] Fig. 2 is a schematic depiction of fshows] the actual inspection of 

[the] printed products, which actual inspection is performed in two stages, namely 
in a first, learning mode 17 and a downstream connected second, inspection mode 
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18. The aim of the inspection of printed products, in the learning mode 17, is the 

generation, pixel by pixel, of reference data values 19, which are then compared, 
in the subsequent inspection mode 18, with the output signals 12, 13 of the 
compensation color channels 07, 08 of the appropriate inspected pixels. In the 
learning mode 17, the image contents of one reference image 21, or the image 
contents of several reference images 21, are analyzed . The fin that the] image 
contents of each pixel in the reference image or images are entered into three 
color channels 01, 02, 03 and a subsequent adaptation withfinl respect to 
perception of the image signals of each color channel 01, 02, 03, is performed, 
Further f. and thereafter further] processing of the image sensor signals, in 
accordance with the above r described compensation color method, is performed. 
Then the output signals 12, 13 of the compensation color channels 07, 08 
obtained for each pixel of the reference are stored in a reference data memory. It 
is useful, for the purpose of also taking into consideration permissible fluctuations 
of the reference images 21, if several reference images 21 are considered in the 
learning mode 17. Because of this consideration of several reference images, it is 
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thus possible for the reference data values 19', 19" of each pixel that is stored in 

the reference data memory to have a defined permissible fluctuation tolerance. 
The fluctuation tolerance can be determined either by the use of 
minimum/maximum values, or from the standard deviation of the obtained data of 
the image contents of the reference images 21 of each pixel. 
[029] Then, in the actual inspection mode 18, a comparison, on a pixel by 

pixel basis , of the output siqnals fvalues] 12, 13 of the first and second 
compensation color channels 07, 08 of an inspection image 22, with the reference 
data values 19", 19" taken from the reference data memory takes place. The 
comparison of the image values with the reference values can be performed by 
the use fmeans] of a linear or a non-linear classifier 23, and in particular by the 
use[means] of threshold value classifiers, Euclidic distance classifiers, Bayes 
classifiers, fuzzy classifiers, or artificial neuronic networks. Subsequently an 
acceptable/unacceptable decision is made regarding the inspection image 22 . 
[030] While a preferred embodiment of a method for analyzing the color 

deviations in images using an image sensor, in accordance with the present 
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invention, has been set forth fully and completely hereinabove, it will be apparent 

to one of skill in the art that various changes in. for example, the specific image 
being inspected, the procedures to be followed once the image has been 
inspected, and the like could be made without departing from the true spirit and 
scope of the present invention which is accordingly to be limited only bv the 
following claims. 



WHAT IS CLAIMED IS: 
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[List of Reference Symbols 

01 First (red) color channel 

02 Second (green) color channel 

03 Third (blue) color channel 

04 First calculation specification 

05 - 

06 Second calculation specification 

07 First (red/green) compensation color channel, 
first new color channel 

08 Second (blue/yellow) compensation color 
channel, second new color channel 

09 Non-linear transformation 

10 - 

11 Coefficients K, (I = 1 ...4) 

12 Output signal of the first (red/green) 
compensation color channel, output value 

13 Output signal of the second (blue/yellow) 
compensation color channel, output value 

14 Minimum of the red and green color channel 

15 - 

16 Low pass filter 

17 Learning mode 

18 Inspection mode 

1 9 Reference data values 

20 - 

21 Reference image 

22 Inspection image 

23 Classifier, classifier system] 
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[19' Output signal, reference data value 
19" Output signal, reference data value] 
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